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350- 
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CORNERS OF HIGH CURVATURE 
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DETERMINE PATTERN CONTRAST AND STORE IN MODEL 
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FIG. 4 



TITLE: METHOD FOR FAST, ROBUST, MULTI-DIMENSIONAL PATTERN RECOGNITION 
INVENTOR NAME: SILVER, ET AL. 



5/34 




BOUNDARY POINT CONNECTING 
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PROBE PLACEMENT 
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MODEL OBJECT 
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TYPE 


NOTES 
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PROBES 


LIST OF PROBE 
OBJECTS 


PROBES CREATED BY 
TRAINING STEP 370 
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GRANULARITY 


REAL NUMBER 


GRANULARITY CHOSEN DURING 
TRAINING STEP 300 


1020- 




CONTRAST 


REAL NUMBER 


CONTRAST OF TRAINING PATTERN 
DETERMINED IN TRAINING STEP 380 
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TYPE 


NOTES 


1100- 




POSITION 


REAL 2-VECTOR 


PROBE POSITION, PATTERN COORDS 


1110- 




DIRECTION 


BINARY ANGLE 


EXPECTED GRADIENT DIRECTION, 
PATTERN COORDS 


1120- 




WEIGHT 


REAL NUMBER 


PROBE WEIGHT, 
POSITIVE OR NEGATIVE 



7 



PROBE 
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NOTES 
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1140- 




DIRECTION 


BINARY ANGLE 


MAPPED GRADIENT DIRECTION 
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FUNCTION: COMPILEPROBES RETURNS LIST OF COMPILED-PROBE OBJECTS 




INPUTS 






NAME 


TYPE 


NOTES 


1202- 


MAP 


2D COORDINATE 
TRANSFORM 


COORDINATE TRANSFORM 
REPRESENTING SPECIFIC SETTING 
OF GENERALIZED-DOF PARAMETERS 


1204- 


- PROBEMER 


INTEGER 
RECTANGLE 


A REFERENCE TO A RECTANGLE TO 
BE SET TO THE MINIMUM ENCLOSING 
RECTANGLE OF THE PIXEL OFFSETS 
OF THE COMPILED PROBES 













1205- 



1210' 



1200 



SET PROBEMER TO A NULL RECTANGLE 



I 



SET LIST OF COMPILED-PROBE OBJECTS 
CPLISTTONULL 



1215- 



I 



FOR EACH PROBE II 
PROBE LIST 1000 



1255 
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1225- 
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ALLOCATE NEW COMPILED-PROBE OBJECT CP 
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SET CP.WEIGHT TO PROBE.WEIGHT 



RETURN CPLIST 
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MAP 
PROBES 



mo- 




LET THE MATRIX C BE THE NON-TRANSLATION PORTION OF MAP 
LET THE VECTOR t BE THE TRANSLATION PORTION OF MAP 



1235- 



LET THE VECTOR p BE PROBE.POSITION 
LET w x BE THE PIXEL ADDRESS DIFFERENCE BETWEEN COLUMNS 

LET w , BE THE PIXEL ADDRESS DIFFERENCE BETWEEN ROWS 
y SET CP.OFFSET AS FOLLOWS: 

p'=Cp + t 
x = round( p' x ) 
y = round(p' ) 
CP.OFFSET = xw x + yw 
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LET 0 BE PROBE.DIRECTION 
SET CP.DIRECTION TO THE VALUE: 
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det(C) 




1290 



I 



ENLARGE PROBEMER TO INCLUDE THE POINT (X,Y) COMPUTED IN STEP 1235 



1250 



^ CONTINUE LOOP ) 



1245 



PROBE COMPILER CONTINUED 
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TARGET 
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GENERALIZED-DOF OBJECT 





NAME 


TYPES 


NOTES 


1400— 


LOW 


REAL NUMBER 


RFOI IF^TFI*) 1 flW FMn fiF 
SEARCH RANGE 


1405- 


HIGH 


REAL NUMBER 


RFOI IFQTFR WftH FMn OF 

SEARCH RANGE 


1410— 


' MAXSTEPSIZE 


REAL NUMBER 


MAXIMUM STEP SIZE 


1415- 


' DUPRANGE 


REAL NUMBER 


DUPLICATE DETECTION RANGE 


1420- 


START 


REAL NUMBER 


ACTUAL LOW END OF SEARCH RANGE 


1430- 


NUMCOARSESTEPS 


INTEGER 


Ml 1MRFR fiF PfiAR^F QTFPQ FRDM 

START TO STOP 


1435— 


STEPSIZE 


REAL NUMBER 


APTIJAI ^TFP <^I7F RPRIX/PD FRDM 

MAXSTEPSIZE AND PARAMETER RANGE 


1440- 


CYCLE 


REAL NUMBER 


IF DOF IS CYCLIC VALUE FOR 
ONE CYCLE; ELSEO 


1445- 


MAPPER 


TRANSFORM-VALUED 
FUNCTION OF REAL 
ARGUMENT 


CONVERT DOF PARAMETER TO 
CORRESPONDING TRANSFORM 


1450- 


' STEPSIZEMATRIX 


2 X 2-MATRIX 


MATRIX FOR COMPUTING 
MAXSTEPSIZE 


1455- 


STEPSIZEFACTOR 


REAL NUMBER 


CONVERSION FACTOR FOR 
COMPUTING MAXSTEPSIZE 


1460- 


• SCALEFACTOR 


REAL-VALUED 
FUNCTION 


"AVERAGE" SCALE FACTOR BASED ON 
SETTINGS OF LOW AND HIGH 



1490 



GENERERALIZED-DOF 

FIG. 14 
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150 
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RESULT OBJECT 





NAME 


TYPE 


NOTES 


1700- 


POSITION 


REAL 2-VECTOR 


PROBE ORIGIN AT MATCH 
POSITION, IMAGE COORDS 


1710- 


PROBEMER 


REAL 
RECTANGLE 


MIN. ENCLOSING RECTANGLE OF 
PROBES AT MATCH POSITION, 
IMAGE COORDS 


1720- 


SCORE 


REAL NUMBER 


MATCH SCORE 


1730- 


CONTRAST 


REAL NUMBER 


WEIGHTED MEDIAN GRADIENT 
MAGNITUDE UNDER POSITIVE 
PROBES 


1740- 


DOFPARAMETERS 


LIST OF REAL NUMBERS 


DOF PARAMETERS AT MATCH POSE 


1750- 


DOFINDICES 


LIST OF INTEGERS 


DOF STEP INDICES AT MATCH POSE 


1760- 


PROBERATINGS 


LIST OF REAL NUMBERS 


LIST OF INDIVIDUAL PROBE RATINGS 
Rniag * R djr FROM THIRD MATCH 

FUNCTION S 3 



1790 

RESULT 
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OVERLAP CALCULATION 

FIG. 18A 




OVERLAP CALCULATION 
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1920- 
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mo- 
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SET MODEL TO MODEL 120 
SET DOFLIST TO LIST OF GENERALIZED-DOFs 150 



I 



DETERMINE NOMINAL SCALE FACTOR OF DOFLIST 



I 



DETERMINE RUN-TIME GRANULARITY 



I 



COMPUTE GRADIENT MAGNITUDE IMAGE 242 AND 
GRADIENT DIRECTION IMAGE 244 FROM RUN-TIME IMAGE 130 



DETERMINE RANGE AND STEP SIZE FOR EACH ELEMENT OF DOFLIST 



SET RESULTS TO COARSESCANDOF(DOFLIST, I) 



COMPUTE THIRD MATCH SCORE S3 FOR EACH ELEMENT OF RESULTS 



1935- 



DISCARD DUPLICATE AND WEAK ELEMENTS OF RESULTS 



mo- 



1945- 



I 



FINE SCAN STEP 



I 



COMPUTE THIRD MATCH SCORE Sg FOR EACH ELEMENT OF RESULTS 



I 



1950 - DISCARD DUPLICATE AND WEAK ELEMENTS OF RESULTS 



FLOW CHART OF RUN-TIME STEP 140 

FIG. 19 
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\ 


2000- 

YES 

t 


SET NUMCOA 
CEILING ((H 
MAXSTI 


RSESTEPSTO 

GH-LOW)/ 

EPSIZE) 








2020 2005 -\ SET NUMCOARSESTEPS T0 1 | 



SET STEPSIZE TO (HIGH - LOW) / 
NUMCOARSESTEPS 



2025 



2010- 



SET START TO (LOW + HIGH) / 2~| 




■2030 

CYCLE >0 AND IS \ YES 
=CYCLE. 



SET START TO LOW 



SET START TO 
LOW -STEPSIZE/ 2 



2050 



ADD 2 TO NUMCOARSESTEPS \ ^2060 
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I 



DONE 



FLOW CHART OF PORTION OF STEP 1920 

FIG. 20 
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FUNCTION: COARSESCANDOF RETURNS LIST OF RESULT OBJECTS 




INPUTS 






NAME 


TYPE 


NOTES 


2102- 


DOFLIST 


LIST OF GENERALIZED-DOF OBJECTS 


PARTIAL LIST STARTING WITH 
CURRENT GENERALIZED-DOF 


2104- 


MAP 


2D COORDINATE TRANSFORM 


PARTIAL POSE FROM OUTER 
LOOP GENERALIZED-DOFs 



^ES^DOFLIST^^ 



T 
2100 



v^EMPTY?^^ 

[NO 



SET RESULTS TO 
COARSESCANXY(MAP) 



2112 



SET DOF TO FIRST ELEMENT OF DOFLIST, 
AND SET INNERDOFs TO THE REST OF DOFLIST 
(WHICH MAY BE EMPTY) 



■2114 



SET RESULTS TO AN EMPTY LIST 



I 



]-2//6 



FOR VALUES OF INDEX FROM 
0 TO DOF.NUMCOARSESTEPS - 1 



2130 

L 



^2118 . i > 

>— SEARCH I 

Lloop^J 



■2120 



FOR EACH RESULT OBJEC T r IN RESULTS I PEAK 

■ ^ I LOOP 



I 



DELETE ALL RESULT OBJECTS IN RESULTS 
THAT ARE MARKED FOR DELETION 



C 



5 




2122 2/60 



RETURN RESULTS 



J^2124 



COARSE SCAN GENERALIZED-DOF 

FIG. 21 A 
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SEARCH ^2130 
LOOP 



SET x TO DOF.START + INDEX'DOF.COARSESTEPSIZE 




r 


SETSTEPRESULTSTOCOA 
DOF.MAPPE 


RSESCANDOF(INNERDOFs, 
!R(X)*MAP) 



2140 



^2142 



FOR EACH RESULT OBJECT r IN STEPRESULTS 



ADD x TO BEGINNING OF 
R.DOFPARAMETERS 



2146 



ADD INDEX TO BEGINNING 
OF R.DOFINDICES 



2148 



( CONTINUE LOOP ^2150 



ADD STEPRESULTS TO THE END OF RESULTS 



c 



I 



2152 



CONTINUE LOOP 



> 



2154 



COARSE SCAN GENERALIZED-DOF CONTINUED 

FIG. 21B 
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2160- 



2170- 



2m- 




SEARCH RESULTS FOR A RESULT OBJECT 
PREVRESULT THAT IS A "PREVIOUS NEIGHBOR" OF r 



I 



SEARCH RESULTS FOR A RESULT OBJECT 
NEXTRESULT THAT IS A "NEXT NEIGHBOR" OF r 



2774- 



IS R.SCORE > 
PREVRESULT.SCORE 
AND IS R.SCORE >= 
NEXTRESULT.SCORE 
? 



YES 



2178 



2m- 



MARK r FOR DELETION 



INTERPOLATE FIRST ELEMENT OF 
R. DOFPARAMETERS BASED ON R AND 
NEIGHBORS PREVRESULT AND NEXTRESULT 



2180- 



IF BOTH NEIGHBORS WERE FOUND, INTERPOLATE 
R.SCORE BASED ON r AND NEIGHBORS 
PREVRESULT AND NEXTRESULT 



2182^C 



CONTINUE LOOP 



COARSE SCAN GENERALIZED-DOF CONTINUED 



FIG. 21 C 



TITLE: METHOD FOR FAST, ROBUST, MULTI-DIMENSIONAL PATTERN RECOGNITION 
INVENTOR NAME: SILVER, ET AL. 



25/34 



FUNCTION: COARSESCANXY RETURNS LIST OF RESULT OBJECTS 



INPUTS 





NAME 


TYPE 


NOTES 


2202- 


MAP 


2D COORDINATE TRANSFORM 


POSE FOR NON-TRANSLATION 
DEGREES OF FREEDOM 



"T" 

2200 



2210- 



2212- 



SET LIST OF RESULT OBJECTS RESULTS TO EMPTY LIST 



ALLOCATE RECTANGLE MER AND SET LIST OF 
COMPILED-PROBES CPLISTTO COMPILEPROBES(MAP, MER) 



2214- 



FOR EACH GRADIENT DIRECTION IMAGE OFFSET a SELECTED BY 
THE CHOSEN SCAN PATTERN, AND SUCH THAT THE IMAGE 
CONTAINS ALL THE MAPPED PROBES AT THAT OFFSET, 
EVALUATE FIRST MATCH FUNCTION S^a) 



2216- 



FOR EACH VALUE OF 

SAa) SCORE EVALUATED 
1 IN STEP 2214 



C 



IS SCORE ABOVE THE 
NOISE THRESHOLD AND A 
"PEAK" IN RELATION TO 
NEIGHBORING SCORES? 



2220 ~( 




2240 



RETURN RESULTS 



J-2222 



COARSE SCAN X - Y POSITION 

FIG. 22 A 
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2240 



ALLOCATE NEW RESULT OBJECT RESULT 



I 



\2242 



SET RESULT.POSITION TO INTERPOLATED POSITION 
SET RESULT.SCORE TO INTERPOLATED SCORE 
SET RESULT.PROBEMER TO MER OFFSET BY INTERPOLATED POSITION 
SET RESULT.DOFPARAMETERS AND RESULT.DOFINDICES TO EMPTY LISTS 



2244 



SEARCH RESULTS FOR RESULT OBJECT r 
THAT IS A "DUPLICATE" OF RESULT 




2246 



2256 



ADD RESULT TO 
END OF RESULTS 



DISCARD RESULT 



1 



( CONTINUE LOOP ^ 2258 



COARSE SCAN X - Y POSITION CONTINUED 



FIG. 22B 
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2430 2435 
HEXAGONAL PEAK DETECTION 



FIG. 24A 




HEXAGONAL INTERPOLATION 



FIG. 24B 
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2500 




DO TWICE ^ — 


r 




2510 — FOR EACH DOF IN DOFLIST 


\ 


2520- 


2530- FOR EACH RESULT IN RESULTS 







} 


f 


DIVIDE DOF.STEPSIZE BY 2 | 



2540- 



FINESCANDOF (DOFLIST, I, RESULT) | 



FINE SCAN STEP 1940 

FIG. 25 
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PROCEDURE: FINESCANDOF 



INPUTS 



2602- 



NAME 


TYPE 


NOTES 


DOFLIST 


LIST OF GENERALIZED-DOF OBJECTS 


PARTIAL LIST STARTING WITH 
CURRENT GENERALIZED-DOF 


MAP 


2D COORDINATE TRANSFORM 


PARTIAL POSE FROM OUTER 
LOOP GENERALIZED-DOFS 


RESULT 


RESULT OBJECT 


RESULT TO REFINE 





26/0- 

YES -^DOFLISr 
EMPTY? 



NO 



"T" 

2600 



2700 



SET DOF TO FIRST ELEMENT OF DOFLIST, 
AND SET INNERDOFS TO THE REST OF DOFLIST 



2630- 



2640- 



I 



SET V TO ELEMENT OF RESULT.DOFPARAMETERS 
CORRESPONDING TO DOF 



I 



FINESCANDOFflNNERDOFS, DOF.MAPPER(v)« MAP, RESULT) | 




FINE SCAN GENERALIZED-DOF 



FIG. 26 
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2700 



ALLOCATE RECTANGLE MER AND SET LIST OF 
COMPILED-PROBES CPLISTTO COMPILEPROBES (MAP, MER) 



2710 



FOR EACH GRADIENT DIRECTION IMAGE OFFSET a SELECTED BY 
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